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(57) Abstract: Anatomical matching of images acquired by different imaging modalities plays an important role in diagnostic med- 
ical imaging. In common medical practice such matching takes place after the acquisition of the data sets containing the information 
to be matched and while utilizing standard post-processing algorithms. The invention provides a method for the acquisition of 
anatomically matched images while using the information concerning the position and orientation of the first imaging modality (1) 
relative to the object. Upon selection of a relevant image from the primary data set acquired by means of the first imaging modality, 
the co-ordinates which unambiguously define the position of the first imaging apparatus relative to this image are defined. These 
co-ordinates are made available to the second imaging modality (2) which is adjusted in confomiity therewith. The image acquired 
by the second imaging modality will thus be anatomatically matched with the pnmaiy image. 



wo 02/03863 PCT/EPOl/07254 

1 

Geometry matching for imaging medical apparatus 



The invention relates to a method of generating anatomically matching images 
by means of a system which includes at least two imaging medical apparatus. 

The invention also relates to a system for carrying out the method. 

In contemporary medical practice it is often desirable to examine a patient by 
S means of a plurality of imaging medical apparatus, each imaging medical apparatus 
producing its own data set for diagnosis or further treatment The evaluation of cranial 
disorders is an example of such multi-facility diagnosis. It is known that an MR apparatus 
constitutes a suitable diagnostic facility for the imaging of soft tissues. In the case of, for 
example, a cranial tumor it may be desirable to image a region of interest of tiie patient 
10 further by means of, for example a CT apparatus and possibly additionally by means of a 

PET scanner. For the determination of the location of the disorder it is necessary to compare 
and match the volume data produced by such imaging medical apparatus. In contemporary 
medical practice all sets of volume data are acquired independently of one another; the 
matching of the geometries so as to realize anatomically matching images is performed in 
1 5 retrospect by selection and computer reconstruction of the relevant data sets. 



Such a method, for retrospective matching of the geometries for different 
images produced by imaging medical apparatus is knoAvn from the article by F. W. Zonneveld 

20 "A decade of clinical three-dimensional imaging: a review". Investigative Radiology, 29, No. 
7, 1994. The cited publication discloses a method for the matching of anatomically 
corresponding images from data sets already produced by different imaging medical 
apparatus. The objects to be imaged may be a variety of cranial disorders, for example 
tumors or neurovascular anomalies. The known method for matching the objects to be 

25 imaged utilizes a pattern recognition algorithm in combination with other algorithms, for 

example, an image reconstruction algorithm. The known matching method has a drawback in 
that the matching of the relevant objects can take place only in retrospect, so that the 
matching of the images could be affected by geometrical distortion of the original images. 
Moreover, such matching methods generally are very time-consuming and their success is 
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highly dependent on the matching algorithm xised. Firrtheraiore, execxition of such methods 
necessitates interaction with the user. These problems become critical notably in the case of 
cranial interventions which must not only be fast but also very precise so as to minimize any 
side effects of the intervention. 



It is an object of tiie present invention to provide a method of producing 
anatomically corresponding images by matching the geometries of different imaging medical 
apparatus in prospective. To this end, the method in accordance with the invention is 
characterized in that it includes: acquisition of a data set containing a first image by means of 
a first apparatus; selection of a plane containing the first image from the data set; assignment 
of first co-ordinates relative to the first apparatus to the plane containing the first image; 
making the first co-ordinates available to the second apparatus; adjustment of the second 
apparatus in conformity with the first co-ordinates; formation of the second image while 
utilizing said adjustment. In conformity with this method an initial acquisition of the data set 
of a patient is performed by means of the first imaging medical apparatus. In order to relate 
the spatial position and the orientation of this data set to the spatial adjustment of the first 
imaging medical apparatus, co-ordinates relative to the first imaging medical, apparatus are 
assigned to said data set. Generally speaking, the data set may be a two-dimensional data set 
or a three-dimensional data set. A two-dimensional data set is limited to a cross-section of the 
patient; a three-dimensional data set may contain a number of two-dimensional planes or may 
consist of intrinsic three-dimensional volume data, that is, no structure of planes is 
distinguished yet upon storage of this data. Generally speaking, a plane containing 
information that is relevant to the diagnosis does not correspond to one of the planes of the 
original two-dimensional data set A selection step for selecting or reconstructing a plane 
containing the first image is also required when the data set is a three-dimensional volume 
data set. This data processing step can be performed by means of reconstmction algorithms 
that are known per se. After selection of the plane containing the first image, the first co- 
ordinates relative to the first imaging medical apparatus are assigned to this plane. The first 
plane is thus characterized relative to the first imaging medical apparatus. In order to produce 
an anatomically corresponding image with the second imaging medical apparatus, this 
apparatus must be adjusted in conformity with the first co-ordinates. This becomes possible 
by making the first co-ordinates available to the second apparatus. Generally speaking, it is 
desirable that for the adjustment of the second apparatus in conformity with the first co- 
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ordinates the second apparatus performs a so-called co-ordinate transformation operation so 
as to calculate own co-ordinates that define a second plane that corresponds to the first plane. 
A number of imaging medical apparatus could act as the first imaging medical apparatus in 
the system. In that case the execution of the co-ordinate transformation necessitates the 
S stor^e of reference co-ordinates for every other imaging medical apparatus in the second 
imaging medical apparatus. After the second apparatus has been adjusted in conformity witili 
the first co-ordinates, the second image is formed; this second image anatomically 
corresponds to the first image. 

A first version of the method in accordance with the invention is characterized 

10 in that the first co-ordinates are made available by means of a computer included in the 
system. The computer in this version writes in the first co-ordinates of the first imaging 
medical apparatus. This version offers the advantage that the computer can be arranged in 
such a manner that the first co-ordinates are made available in a format that suits the second 
imaging medical apparatus. This may be necessary in a situation where the formats of the 

1 5 first and the second imaging medical apparatus are not compatible, A further advantage of 
the incorporation of a computer in the system consists in the fact that the computer can be 
arranged as a central computer in which all information concerning the patients is stored so 
as to avoid patient identification errors. The presence of a central computer simplifies the 
data transport between the imaging apparatus in case an essential pause is inserted between 

20 the first and subsequent acquisitions of the images. Moreover, the commimication protocol of 
the system may be conceived such that the second imaging medical apparatus itself 
^proaches the central computer concerning the availability of the first co-ordinates. 

A further version of the method in accordance with the invention is 
characterized in that for each connected imaging medical apparatus a reference co-ordinate 

25 system is stored in a table present in the compiiter. This version offers the advantage that all 
information concerning the reference co-ordinates is stored in the computer so that the 
individual imaging medical apparatus will not have to follow up on up-to-date information 
concerning any changes in the configumtion of other imaging medical apparatus, for example 
in a situation where new apparatus have been added or apparatus thus fer present have been 

30 removed. 

A further version of the method in accordance with the invention is 
characterized in that the second reference co-ordinate system is calculated &om the first 
reference co-ordinate system by the computer. This version offers the advantage that the 
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second imaging medical apparatus does not have to perform the co-ordinate transformation 
operation, all co-ordinate transformations being performed in the computer. 

A further version of the method in accordance with the invention is 
characterized in that the jSrst co-ordinates are made available via a cable which directly 
5 interconnects two imaging medical apparatus. This special version is intended for a situation 
where a number of imaging medical apparatus, for example two apparatus, co-operate in such 
a manner that a direct exchange of information is necessary. The use of a cable between these 
two medical ^paratus offers the advantage that the cable for the data transmission is less 
susceptible to interference than a network or a radio link. An example of such a system with 

10 two imaging medical apparatus consists of a combination of an MR apparatus and an X-ray 
apparatus, botii of said apparatus being used, for example to carry out a cardiovascular 
intervention. During this intervention a patient is immobilized on a patient table that can be 
transported between these two medical apparatus. Furthermore, a relation is known between 
the reference co-ordinate systems of these two medical apparatus. After the selection of a 

1 5 first relevant plane within the first data set and after assignment of the first co-ordinates to 
this first plane, the adjusting co-ordinates are applied to the X-ray apparatus via the data 
transmission cable. Subsequently, the patient is transported to the X-ray apparatus on the 
same patient table. The adjusting co-ordinates determine the position of the gantry of the X- 
ray apparatus relative to the patient table, so that an X-ray image can be formed. The X-ray 

20 image of the patient formed in conformity with this method anatomically corresponds to the 
image of the first plane. This method of co-operation between an MR apparatus and an X-ray 
apparatus offers the advantage that the exposure projection of the patient by the X-ray 
apparatus is known a priori. On-line optibnaization of the exposure projection can thus be 
dispensed with, so that the overall radiation dose whereto the patient and the staff of the 

25 opemting room are exposed during such an intervention is reduced. 



These and other aspects of the invention will be described in detail hereinafter 
with reference to some Figures; therein: 
30 Fig. 1 illustrates diagrammatically the system for carrying out the method in 

accordance with the invention, and 

Fig. 2 shows diagranunatically an example of a system as shown in Fig. 1 in 
which the apparatus are interconnected by a transmission cable. 
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Fig. 1 shows diagrammatically an embodiment of a system 1 00 that is fomied 
by two imaging medical apparatus 10, 20 for carrying out the method for generating 
anatomically corresponding images in accordance with the invention. The first medical 
5 ^paratus 1 includes meanis 1 1 for the acquisition of the first data set For example, when the 
first imaging medical apparatus is an MR ^paratus, the device for producing and detecting 
an RF signal forms part of the means 'for the acquisition of the first data set In the case of an 
X-ray apparatus, the X-ray tube and the X-ray detector form part of the means for the 
acquisition of the first data set. 

10 For the local assignment of the signal acquired fi:om the studied volume within 

the patient to the setting of the first apparatus 1 0, the latter is provided with assignment 
means 12 which sissign the first co-ordinates relative to the first imaging medical apparatus to 
a plane containing the first image. For cases where a first image that is relevant to the 
diagnosis is to be selected firom the already acquired data set, the first imaging medical 

15 apparatus includes selection means 13. An example of such selection means consists of a 
computer program that executes a data processing step. The assignment means 12 
subsequentiy assign the first co-ordinates to the selected image relative to the first imaging 
medical apparatus. The first imaging medical apparatus 10 also includes means 14 for 
making the first co-ordinates available to the second apparatus 20. An example of such 

20 means consists of a standard TCP/BP communication protocol. The patient is subsequentiy 

examined by means of the second imaging medical apparatus 20 which includes means 21 for 
the acquisition of an image. In order to adjust the second imaging medial apparatus 20 in 
conformity v^th the adjustment of the first imaging medical apparatus relative to the patient, 
the apparatus 20 includes means 24 for writing in the first co-ordinates made available by the 

25 first apparatus 10. This write step can be performed by way of a communication protocol that 
is known per se, for example by means of a TCP/IP protocol. When the second apparatus is 
of a type other than the first apparatus, it is necessary to perform a co-ordinate transformation 
from the first apparatus to the second apparatus. This step can be performed by means of 
translation means 26. An example of such translation means consists of a conversion table 

30 that is stored in the second apparatus. For the acquisition of an image that anaton[iically 

corresponds to the first image by means of the second apparatus, the latter must be adjusted 
in conformity with the fibrst co-ordinates. This step is executed by means of adjusting means 
25. Subsequently, the image anatomically corresponding to the first image is acquired by 
means of the means 21 of the second apparatus 20. If desired, the execution of the operational 



wo 02/03863 PCT/EPO 1/07254 

6 

steps concerning the making available of the first co-ordinates, the writing in of the first co- 
ordinates and the translation of the first co-ordinates to the co-ordinates that are suitable for 
the second apparatus can be delegated to a computer that is included in the system. An 
example in v^ch said fimctionalities are delegated to the computer is diagrammatically 
5 represented by a functional block 30 in Fig. 1 . 

Fig. 2 illustrates diagrammatically the co-operation between two imaging 
medical apparatus 1, 2 for the execution of the method in accordance with the invention, said 
apparatus being interconnected by means of a data transmission cable 3. The first apparatus 1 
is an MR apparatus and the second apparatus 2 is an X-ray apparatus. An example of such 

10 co-operation of the two imaging medical apparatus can be found in a suite for cranial 

interventions in which a region to be treated is defined by means of the MR apparatus and 
subsequently examined by means of the X-ray apparatus. A patient to be examined is 
unmobilized on a patient table 4 that can be transported between the table support systems 6 
and 8 of said apparatus. For a suitable operation of this assembly of medical apparatus it isr 

15 desirable that the relationship of the respective co-ordinate systems is known and stored, for 
example, in one of the apparatus. The assembly operates as follows: first an image is formed 
by means of the MR apparatus 1. Subsequently, a patient is transported, on the same patient 
table 4, to the X-ray apparatus 2 whereby an anatomically matching image is to be formed. 
Because of the fact that the position of the patient relative to the patient table is not changed 

20 between the exposures by means of the medical apparatus 1 and 2, it is easy to adjust the . 
means 21 for the acquisition of an image anatomically corresponding to the first image by the 
second apparatus 2. The necessary adjusting parameters are made available to the second 
apparatus via the data transmission cable 3. 
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1 . A method of generating anatomically matching hnages by means of a system 
(100) which includes at least two imaging medical apparatus (10, 20), characterized in that 
the method includes the following steps: 

- acquisition of a data set containing a first image by means of a first apparatus 

5 (10); 

- selection of a plane containing the first image fi:om the data set; 

- assignment of first co-ordinates relative to the first apparatus to the plane 
containing the first image; 

- making the first co-ordinates available to the second apparatus; 

10 - adjustment of the second apparatus (20) in conformity with the first co- 

ordinates; 

- formation of the second image while utilizing said adjustment. 

2. A method as claimed in claim 1 , wherein the first co-ordinates are made 
1 5 available by means of a computer (30) included in the system. 

3. A method as claimed in claim 2, wherein for each connected imaging medical 
apparatus (10, 20) a reference co-ordinate system is stored in a table present in the computer 
(30). 

20 

4. A method as claimed in claim 2 or 3, wherein the second reference co-ordinate 
system is calculated firom the first reference co-ordinate system by the computer (30). 

5. A method as claimed in claim 1, wherein a data set containing the first image 
25 is stored in the computer (30) after acquisition by means of the first imaging medical 

apparatus. 
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6. A method as claimed in claim 1, wherein the first co-ordinates are made 

available via a cable (3) which directly intercoimects two imaging medical apparatus (10, 
20). 

5 7. A system (100) for carrying out the method claimed in claim 1, including: 

- a first imaging medical apparatus (10) for the acquisition of a first image; 

- a second imagmg medical apparatus (20) for the acquisition of a second 
image that anatomically corresponds to the first image, characterized in that the system also 
includes: 

10 - means (12) for assigning first co-ordinates relative to the first imaging 

medical apparatus (10) to a plane containing the first image; 

- means (14) for making the first co-ordinates available to the second 

apparatus, 

- tiie second imaging medical apparatus being provided with adjusting means 
1 5 (25) for adjusting this apparatus in conformity with Ihe first co-ordinates. 

8. A system as claimed in claim 7, also including a computer (30) which is 

arranged to make the first co-ordinates available to the second imaging medical apparatus. 

20 9. A system as claimed in claim 8, wherein the computer (30) is provided with a 

table wherein a reference co-ordinate system is stored for each connected imaging medical 
apparatus. 

10. A system as claimed in claim 7, wherein the first imaging medical apparatus 

25 (1) is an MRI apparatus and the second imaging medical apparatus (2) is an X-ray apparatus, 
said apparatus being interconnected by means of a data transmission cable (3). 
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